AD - A 1 4 1  684 
UNCLASSIFIED 


OPTIMAL  DELAY  ESTIMATION  IN  A  MULTIPLE  SENSOR  ARRAY  \/\ 

HAVING  SPATIALLY  CDRR..IU)  WYOMING  UNIV  LARAMIE  5  DEPT 
OF  ELECTRICAL  ENGINEERING..  R  L  KIRLIN  ET  AL . 

30  SEP  83  N00014-82-K-0048  F/G  12/1 


NL 


DUG  flit  COPY  AD- A 141  684 


ft 


I 


SECURITY  CLASSIFICATION  OF  THIS  PAGE  (Whon  Dot,  Enl.r.d) 


REPORT  DOCUMENTATION  PAGE 

READ  INSTRUCTIONS 

BEFORE  COMPLETING  FORM 

t.  REPORT  NUMBER  2.  GOVT  ACCESSION  NO. 

None  ^  >  .  /]  -  t,  >' 

3.  RECIPIENT'S  CATALOG  NUMBER 

4.  TITLE  (Mtd  Subtttlm) 

Optimal  Delay  Estimation  in  a  Multiple  Sensor 
Array  Having  Spatially  Correlated  Noise. 

S.  TYPE  OF  REPO  NT  4  PERIOD  COVERED 

Annual  technical  report 

Nov.  1,  1982-Oct .  31,  1983 

8.  PERFORMING  ORG.  REPORT  NUMBER 

7.  AUTHORS 

R.  L.  Kirlin  and  Lois  A.  Dewey 

8.  CONTRACT  OR  GRANT  NUMBERS 

N00014-82-K-0048 

S.  PERFORMING  ORGANISATION  NAME  ANO  ADDRESS 

University  of 

P.0.  Box  3295 

Laramie.  WY  82071  .  . 

10.  PROGRAM  ELEMENT.  PROJECT,  TASK 
AREA  6  WORK  UNIT  NUMBERS 

i 

NR-042-470/ 9-24-81 
(410) 

II.  CONTROLLING  OFFICE  NAME  ANC  ..  ORESS 

Chief  of  Naval  Research,  Code  410 

800  N.  Quincy  St. 

Arlington,  VA  22217  ~ 

12.  REPORT  DATE 

September  30,  1983 

13.  NUMBER  OF  PAGES 

65 

14.  MONITORING  AGENCY  NAME  *  AOQRESSIK  dill, ml  from  Controlling  OlllcoJ 

ONR  Resident  Representative 

Rm.  223,  Bandolier  Hall  West 

Albuquerque,  New  Mexico  87131 

IS.  SECURITY  CLASS,  (o  1  e hie  report) 

15V  DECLASSIFICATION/ DOWNGRADING 
SCHEDULE 

16.  DISTRIBUTION  STATEMENT  fo/  R#port;  5  .  ^ 

ip  ^  , 

APPROVED  FOR  PUBLIC  RELEASE:  DISTRIBUTION  UNLIMITED.  - 

1984 

17.  DISTRIBUTION  STATEMENT  (ot  the  ebetrmct  entered  In  Block  20,  II  dllterent  irom  Report) 

Approved  for  Public  Release:  Distribution  Unlimited. 

THE  RUTH  «.  HOOKER 
TECHNICAL  LIBRARY 

18.  SUPPLEMENTARY  NOTES  , .  ~  ^  ,  ...  A 

OCT  1  9  1983 

NAVAL. RESEARCH  LABORATORY 

18.  KEY  WOROS  (Continue  on  toeoree  elde  II  neceeeery  and  Identify  by  block  number) 

Delay  estimation,  multi-sensor  array,  Cramer-Rao  Matrix  Bound, 
spatially  correlated  noise 

20.  A?S1  PACT  (Continue  on  reverie  side  II  neceeeery  and  Identify  by  block  number) 

The  maximal  likelihood  (ML)  estimation  of  time-of-arrival  differences 
for  signals  from  a  single  source  or  target  arriving  at  M  >  2  sensors  has 
been  the  subject  of  a  large  number  of  papers  in  recent  years.  These  time 
differences  or  delays  enable  target  location.  Nearly  all  previous  work  has 
assumed  noises  which  are  independent  among  all  sensors.  Herein  noises  are 
taken  to  have  complex  correlation  between  sensors.  A  set  of  nonlinear 
equations  in  the  unknown  delays  is  derived  and  possible  simplifications 

DO  |  JAN*?)  1473  EDITION  OF  I  NOV  «S  is  OBSOLETE 

84  05  ^11 09 


SECURITY  CLASSIFICATION  OF  THIS  PAGE  (When  Oft tm  Entered) 


■  v> 


I 


SECURITY  CLASSIFICATION  OF  THIS  RAGE  (fk«  Dm*  En ikN) 


20.  (ABSTRACT  Cont.) 

discussed.  The  unknowns  are  in  one  case  the  M-l  delays  referred  to  the 
first  sensor  and  in  another  case  an  M-l  dimensional  subset  of  independent 
delays  from  the  M(M-l)/2  pairwise  delays.  The  Fisher  information  matrix 
(FIM)  for  the  estimates  is  also  derived.  The  Cramer  Rao  Matrix  Bound 
(CRMB) ,  which  is  the  inverse  of  FIM,  will  show  optimal  estimator 
covariances;  these  are  different  than  the  covariances  of  correlator  delay 
estimators  derived  by  Hahn  [4].  Computer  evaluations  are  given  for 
CRMB  elements  with  varied  SNR  and  noise  covariance  values  typical  of 
turbulent  boundary  layer  noise  in  towed  arrays. 


Annual  Report 


Project  Title:  Investigation  of  model  parameters  on  delay  estimates  via 

wequential  state  estimation. 

Contract  No.:  N00014-82-K-0048 

Principal  Investigator:  Professor  R.  Lynn  Kirlin 

Department  of  Electrical  Engineering 
University  of  Wyoming 
Laramie,  Wyoming  82071 
307-766-6137 

Long  Range  Scientific  Objectives: 

The  accuracy  of  the  location  parameters  is  a  function  of  delay  measure¬ 
ment  variance,  apriori  variance,  and  number  of  sensors.  Depending  on  the 
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Summary  of  Work,  1  Nov.  1982  -  30  Sept.  1983: 

The  second  year  of  this  contract  has  considered  the  effects  of  spatially 
correlated  noise  on  delay  estimation  in  linear  arrays.  The  nonlinear 
equations  for  the  multiple  (M-l)  Maximum  Likelihood  (ML)  estimators  have 
been  derived.  Either  delays  with  respect  to  the  1st  (end)  sensor  or  any 
independent  M-l  delays  in  the  array  are  usable  as  unknowns.  Cramer-Rao 
Matrix  Bound  elements  have  been  formulated,  computed,  and  plotted  for  a 
number  of  realistic  values  of  noise  correlation  and  other  parameters. 

The  variation  of  the  variance  bound  with  correlation  is  not  as 
significant  as  the  variation  with  array  look  angle;  up  to  5  dB  differences 
were  noted. 

Most  significantly  it  has  been  shown  that  adding  more  sensors  is  not 
always  fruitful  when  spatial  noise  correlation  is  present.  In  the  ranges 
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on  this  subject. 
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suggestions  and  is  re-submitted. 
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on  the  early  work  of  this  years  research)  to  visit  NUSC  in  New  London  in 
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in  April.  There  discussions  with  a  number  of  people  solidified  some  of 
the  details  and  focus  of  this  years  work.  In  particular,  the  work  and 
data  involving  spatially  correlation  noise  in  towed  arrays  was  brought 
to  attention.  This  allowed  practical  values  of  parameters  and  clustered 
configurations  to  be  considered. 
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The  maximal  likelihood  (ML)  estimation  of  time-of -arrival  differences 
for  signals  from  a  single  source  or  target  arriving  at  M  >  2  sensors  has 
been  the  subject  of  a  large  number  of  papers  in  recent  years.  These  time 
differences  or  delays  enable  target  location.  Nearly  all  previous  work  has 
assumed  noises  which  are  independent  among  all  sensors.  Herein  noises  are 
taken  to  have  complex  correlation  between  sensors.  A  set  of  nonlinear 
equations  in  the  unknown  delays  is  derived  and  possible  simplifications 
discussed.  The  unknowns  are  in  one  case  the  M-l  delays  referred  to  the  first 
sensor  and  in  another  case  an  M-l  dimensional  subset  of  independent  delays  from 
the  M(M-l)/2  pairwise  delays.  The  Fisher  information  matrix  (FIM)  for  the 
estimates  is  also  derived.  The  Cramer  Rao  Matrix  Bound  (CRMB),  which  is  the 
inverse  of  FIM,  will  show  optimal  estimator  covariances;  these  are  different 
than  the  covariances  of  correlator  delay  estimators  derived  by  Hahn  [4]. 
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Computer  evaluations  are  given  for  CRMB  elements  with  varied  SNR  and  noise 
covariance  values  typical  of  turbulent  boundary  layer  noise  in  towed  arrays. 
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I.  Introduction 

The  estimation  of  time-of-arrival  differences  for  signals  from  a 
single  source  or  target  arriving  at  multiple  sensors  has  been  the  subject 
of  a  considerable  number  of  papers  in  recent  years.  These  time  delay 
differences,  or  simply  delays,  enable  target  localization  through  straight¬ 
forward  geometrical  considerations  when  the  signal  path  is  non-dispersive 
[1,2].  Although  target  location  is  the  primary  goal,  delay  estimation  is 
essentially  equivalent  as  there  is  a  one-one*,  although  nonlinear,  relation 
between  the  maximum-likelihood  (ML)  delay  vector  and  ML  location  vector. 

Essentially  all  of  the  results  of  available  literature  (except  [9]  have 
been  based  not  only  upon  the  geometric  and  non-dispersive  assumptions  stated 
above  but  also  upon  noise  spectra  which  are  independent  among  sensors.  The 
independent  noise  assumption  is  adequate  if  either  the  sensor  self-noise  is 
dominant  or  the  sensors  are  spatially  separated  sufficiently  such  that  the 
environmental  noise  is  indeed  independent  or  uncorrelated  among  sensors. 
However,  this  is  not  always  a  reasonable  assumption  and  the  effects  of 
spatially  correlated  noise  in  the  estimation  of  delays  and  delay  variances 
must  be  considered.  Thus  appropriate  analyses  are  herein  undertaken  to 
consider  correlated  noise  from  diffuse  sources.  Results  are  compared  to 
those  previously  published  for  independent  sensor  noises. 

Owsley  and  Fay  [11]  have  considered  correlated  noise  when  clustering 
sensors  and  optimizing  beamformers.  The  comparable  optimization  of  delay 
estimation  has  not  previously  been  approached.  By  choosing  the  correlation 
parameter  p,  we  may  include  the  proportionality  of  correlated  turbulent 
boundary  layer  tow-noise  and  isotropic  sensor  noise. 

The  basic  approach  is  to  assume  that  complex  Fourier  coefficients  X.(k) 

t  h  t  h  ^ 

at  the  i—  sensor  for  the  k —  frequency  are  available,  having  been  obtained 

from  T-second  time  records,  where  T  is  long  with  respect  to  the  signal 

correlation  time. 


*  For  an  array  with  three  sensors  in  line  there  is  an  ambiguity  in  the 
sign  of  bearing  angle,  which  we  assume  may  be  solved  with  additional 
information. 


+  This  study  funded  under  office  of  Naval  Research,  contract  number 
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The  time  data  records  are 


xi(t)  =  s(t-d^)  +  n^(t) ,  i  =  1,2, ...M.  (1) 

where  d^  are  the  delays  from  the  reference  sensor  to  the  i—  sensor 

(d^  =  0),  s(t)  is  a  zero-mean,  Gaussian,  stationary  signal,  and  n^(t)  is  the 

til 

additive  Gaussian  noise  at  the  i —  sensor. 


II.  Background 


The  problem  of  delay  vector  estimation  for  multiple  sensors  has  been 
studied  with  the  above  approach  in  original  papers  by  Hahn  and  Tretter  [3], 

Hahn  [4]  and  Schultheiss  [5].  Closely  following  their  presentations,  let 

T/2 

x.(t)  exp{-jkco  t}dt,  k  =  1,2,. . .  ,K,  (2) 


X.(k)  =  ± 


-T/2 


where  =  2tt/T.  Define  a  vector  X  containing  the  above  MK  Fourier 
coefficients  as  elements.  If  S(ui)  and  N^Cw)  are  the  signal  and  noise 

spectra  at  the  i—  sensor,  the  probability  density  for  x  can  be  written 


where 


p(X)  =(/*  n  det  R(k) )  1  exp[-£  XT(k)R_1(k)X*(k)  ] 
k=l  k=l 

X(k)  =  [X1(k),  X2(k), - ^(k)]1 

X  =  [XT(1);  XT(2), - ,XT(K)]T 

V (k)  =  [1,  exp(-jkuiod2) , - .expC-jkuy^) ]T 

N(k)  =  [N^(k)],  an  MxM  matrix  of  noise 

cross-power  spectra 
R(k)  =  N(k)  +  S(k)  V*(k)VT(k) 


(3) 


and  where  *  superscript  denotes  complex  conjugation. 

In  order  to  obtain  the  ML  estimate  of  delays,  determinant  and  inverse 
theorems  of  use  are 

[ R|  =  |N  +  SV*VT|  =  | N |  f I  +  N-1SV*VT!  =  | N | (1  +  SVTN_1V*)  (4) 


3 


-1  -1  -1  T  -1  -IT  -1 

R  =  N  -  N  V*(V  N  V*  +  1/S)  V  N 

-1  ik 

Defining  elements  of  N  as  N  ,  the  likelihood  function  of  the  delay  vector 
T 

D  =  (d2,  d  dM)  is,  using  (4), 

A  =  in  p(X)  =  -in^)  -  l  £n [  |  N  j  (1  +  SVTN_1V*)] 

B+ 

-  I  [xtn-1x*  -  XTN~1V*VTN~1X*1  . 

B+  vtn_1v*  +  i/s 

where  £  means  sum  over  positive  frequencies. 

B+ 

Hahn  and  Tretter  [3]  have  shown  that,  when  N  is  diagonal,  [N^ . . . .N^] , 

the  Fisher  information  matrix  for  D  (FIM  =  -  <grad<grad  £n  A>>  where  <•>  is 
expected  value)  is 


FIM  =  l  2i o 


B+  1  +  l  S/N, 


-1  -1  -1  T  -1 

[(tr  N  )N  -  N  11  N  ] 
P  P  P 


where  N  ^  is  N  ^  with  the  first  row  and  column  removed.  The  Cramer-Rao 
P 

Matrix  bound  (CRMB)  for  the  delays  D  is  (FIM)  .  The  ML  estimate  covariance 
is  known  to  asymptotically  approach  the  CRMB.  The  ML  estimate  for  small 

A 

delays  (D  jLs  the  error  when  D  =  0)  and  independent  noise  is 
~  -IT 

D  =  -<C>  B  ,  ( 


where 


<C>  =  FIM, 


B  =  I  jw  - ^ - 

B+  1  +  /S/N. 


T  -1  T  T  -1 

1  N  [XX  *  -X*X  ]N 
P  P  P 


and  Xp  is  X(k)  with  the  first  element  (X^(k))  removed. 

Hahn  and  Tretter  also  show  that  the  ML  D  estimate  can  be  implemented 
either  as  a  beamformer  (ideally  in  real  time  only  when  the  are  propor¬ 
tional,  because  of  phase-matching  filter  criteria),  or  as  a  cross  correlator 


system  which  produces  the  M(M-l)/2  delay  estimates.  The  correlator  system 
has  cross-spectral  filters 


4 


S/N.N. 

_ Lj _ 

1  +  l  S/N. 


,  i,  j  =  1,  2,  ....  M, 

i  t  j  • 


The  error  covariance  matrix  for  the  pair-wise  delay  estimates  of  the  cor¬ 
relators  is  shown  by  Hahn  [4]  to  have  elements 


/j  \  2ir 

var  “u'  *  T 


.  u2|F.  . 
B  1  ii 


[N.N.  +  S (N .  +  N.  )  ]dco 
i  J  i  J 


(U2lFij|2  Sdco)2 


covar(d„,  d^)  =  0,  i,  j,  k,  i  all  distinct 

covar(d_,d1£)  =  B  ^  SNidlli  ,  i  t  l  (1 

.B  “2!FiJ|2sd“  jB  “2|FitlSi" 

A  A 

“  -  covar  (d  ,  d^)  ,  j  ^  i 

It  is  emphasized  that  these  are  correlator  error  covariances  of  the  d . . 

ij 

and  not  ML  estimator  error  variances,  which  are  derived  herein. 

The  delays  having  covariance  matrix  defined  by  (12)  and  (13)  are  not 

the  M-l  delays  referred  to  a  single  sensor.  Hahn  and  Tretter  have  shown  how 

to  use  weighted  linear  combinations  of  the  M(M-l)/2  cross  correlation  delay 

estimates,  d.,,  to  form  an  estimate  for  D  =  (d.)  which  achieves  the  CRMB  of 
ij  1 


With  independent  noises  maximization  of  A  in  (6)  over  the  vector  D 
concentrates  on  the  second  term  in  the  second  summation,  because  other  terms 
are  not  dependent  on  the  d^.  This  is  not  generally  the  case,  and  an  analytical 
solution  is  not  available,  as  was  pointed  out  in  the  multipath  analysis 
given  by  Owsley  [6].  However,  the  generation  of  a  set  of  nonlinear  equations 
in  the  unknowns  d^  may  be  obtained. 

In  the  next  section  ML  estimator  equations  for  the  M(M-l)/2  pairwise 
delays  are  derived.  Section  IV  produces  the  CRMB  for  these  delays.  Section 
V  considers  the  M-l  delays  d^  -  d^,  and  Section  VI  derives  the  CRMB  for  the 
M-l  delays  d^  -  d^. 


III.  Estimation  of  an  Independent  Subset  of  M(M-l)/2  Delays 


This  section  will  determine  equations  for  ML  estimates  of  an  independent 
subset  of  the  M(M-l)/2  delays  d^  -  d^  =  d^-  In  contrast  most  other  papers 
referenced  find  ML  estimates  of  either  the  M-l  delays  (d^  -  d^) ,  2  <  i  <  M,  or 
other  parameters  such  as  range  and  bearing,  functions  of  which  the  may  be 
written.  The  reason  for  our  choosing  the  d  is  that  a-priori  information 
about  linear  relationships  among  them  may  subsequently  be  used  as  in  [10] 
to  improve  the  delay  estimates  d^  -  d^  or  any  other  subset. 

Because  we  will  find  equations  for  real  variables  and  real  unknowns, 
and  we  wish  to  be  able  to  show  effects  of  correlated  noise  on  various  parts 
of  the  formulations,  double  sums  throughout  the  paper  are  usually  broken  into 
several  pieces. 

Now  consider  the  two  summations  in  (6),  the  only  functions  of  D, 

A'  =  ~l  in [ ( 1  +  S  l  NPP  +  S  ll  NPqe_Ju)(dp  "  dq> )  | N |  ] 

B+  P  P  q^p 


y  y  y  v  y  y  NirNtk  e^<dr  -  V _ ,x* 

B+  i  k  1  t  r  J  NPP  +  n  Npqeju)(dp  "  V  +  ±  k 
p  p  q^p 


(14) 


Thus  we  would  like  to  solve  for  the  d,,  which  maximizes 

ik 


A"  =  ~l  in  (1/S  +  ll  NPqe 
b+  p  q 


pq„-:Mpq) 


+  l  ll  W  I  I 


B+  m  n 


m  n 


Nmr  Ntn 
r  t  1/S  +  ll  Npqe-j"dpq 

p  q 


T  -1  T  -1 

r  r  «_/  v  .  x  N  V*V  N  X*  , 
=  l  [-SLn(g)  +  - - -  ] 


B+ 


g 


where,  using  (15), 

=  1/S  +  VTN-1V*  =  1/S  +  £nPP  +  2  l  l  (cos  cod 

P  P  q>p 


g 


pq 


Re 


(NPq> 


(15) 


(16) 


+  sin  cod  I  {NPq}) 
pq  m 

Differentiating  A''  with  respect  to  (assuming  all  d^  independent)  gives 


(17) 


3  A ' 


3d 


ik 


=  l 

B+ 


3(VTN~1V*) 


3d 


ik 


T  -1  T  -1  T  -1  T  -1  T  -1 

gXN  3(V*V  )N  X*  -  X  N  V*V  N  X*  3 (V  N  V*) 


3d 


ik 


3d 


ik 


(18) 
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Setting  this  equal  to  zero  and  rearranging  gives 
T  -1 


l  f-fSOlm  i  +xtn-i 

B+  3  d  g 


3 (v*yT) 


8  d 


ik 


1  V*VT  •  3 (VTN-1V*) 

g  2 


8  d 


ik 


N  X*}=0  (19) 


The  square-bracketed  terms  in  (19)  are  a  matrix  U(i,k)  =  (u  (i,k))  A  typical 

mn 

element  «  has  values  which  differ  according  to  whether  or  not  (m,n)  = 

(i,k)  or  (k,i).  Using 


and 


(V*VT)  =  eJ(iidmn, 
m,n 


(m,n)  = 

(m,n)  = 

(m,n)  / 

(i,k) 

(k,i) 

(i,k) , (k,i 

ik) 

=  2fc)(-Re  (Nlk}sin  0)dik  +  Im{Nlk}cos  codik) 


(2i 


(20b) 


(20c) 


in  u  (i,k)  give 
mn  / 


j  e^ik  (jw  -  g^g) 


1  J  -jud. 

u  =  —  <  e 
mn  g 


ik  (-jw  -  gj^/g) 


g  ,/g 


-e  mn 


,(m,n)=(i,k) 

, (m,n)=(k, i)  (21) 

,  (m,n)?£(i,k)  ,  (k,i) 


Insertion  of  (21)  into  (19)  constitutes  M(M-l)/2  equations,  nonlinear,  to  be 
solved  for  the  d^.  This  is  pursued  further  in  Appendix  A  for  diffuse  noise. 
Note  that  onlv  M-l  delays  can  be  independent.  We  now  turn  our  attention 
to  the  CRMB. 


a  —  - -  -  -  aiiihSttMIMBBIillih  mi  i  _  M 


: _ J 
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IV.  The  Cramer-Rao  Bound  for  an  Independent  Subset  of  the  M(M-l)/2  Delay 

Estimates  of  d., 

_ lk 

As  is  well  known,  maximum  likelihood  estimators  have  variances  which 
approach  the  Cramer-Rao  bound.  The  variance  bounds  for  the  d  ^  are  the 
elements  in  the  diagonal  of 


CRMB  -  (FIM)  -  (-<grad(grad  £n  A'')^>)  \ 


(22) 


wherein  FIM  is  the  Fisher  Information  Matrix,  grad  A ' '  is  a  row  vector 
whose  nr^-  element  is  the  derivative  of  A*'  with  respect  to  the  nr^  delay 
(the  nr^  d  here),  A’ '  is  the  expression  in  Eq.  (17),  and  <•>  denotes 
expectation.  The  outer  gradient  operator  creates  a  matrix  whose  elements 

a  3  A ' ' 

(rrr — ) .  We  have  already  found  the  inner  partial  —  the  result 
dd  . . 
lk 


are 


3d 


rt 


is  Eq.  (19)  and  following.  For  any  M-l  independent  delays  the  following  applies. 
Taking  and  negating  the  second  partial  with  respect  to  d  gives 


3 

3d 


,  a-V  v  =  v  (  r 

(ad.-  )  M  [§ 


rt 


ik 


B+ 


a 

w 


T  - 1 

,3V  N  V* 


rt 


"5d 


ik 


\  3(VTn~1V*)  9(VTN  1V*)  , 

>  Ta - - -  ] 


ik 


rt 


-  Af  U  xV1  -  xV1  K'gvh  N-1X, 


9d  v  3d., 

rt  ik 


ik 


rt 


T  -1  T  -1 
-  X  N  V*V  N  X* 


9  ,3VTn  1V* 


3d 


(- 


rt 


9dik 


) 


.JgWl  xtn-i  WiN-ix< 

°  ik  rt 


X*] 


+  ^[(xVVvV1!*  jg-TA^V*)  3gVV) 

£_4''  ^ik  5drt 


]} 


-l  i  (- 

B+  8 


981  §2.^2 

,  „T  -1 

_3drt  8 

+  X  N 

32(V*VT)  82  3(V*VT) 

g  3d 


3d  3d., 
rt  ik 


ik 


V*VT - i gi  +  i 

g  3drt  o 


«  01  "rt  V  8l62V‘V 


N  1X*} 


=  l  ~  (g12  "  8,8,/r)  -  7  l  XTN_1BN  XX* 
B+  8  L  z  8  R+ 


(23) 


8 


where 


=  -12- 


’1  3d 


ik 


=  2u)(-Re{Nik}sinajd +  Im{Nllc}cosuxi  ) 


82  =  3d 


2M(-Re{Nrt}sinojd  _  +  Im{N£  L}cos<jJd  ) 

v  r  t  r  t 


rt-, 


rt 


(24) 

(25) 


and  B  -[ b  ] is  found  using 

VT 


.2 

g  =  - -  g— 

g12  3d  3d 

rt  ik 


0, (r,t)  /  (i >k) 


(26) 


2co^(-Re{N'i''<'}cosu3dik  -  Im{N'i'k}sincjdik),  (r,t)  =  (i,k) 


/  0, (r,t)  t  (i. 


k) 


Using 


9 


<X  X  *>  = 
r  t 


and  writing 

j-T  -1  -1 


-icod  *  , 

SeJ  rt  +  N  ,  r  ^  t 


rt 


S  +  N, 


,  r  =  t 


XiN~i  BN_iX*  =  l  b  [  (X  t2  (N1™)2 
u  mm  nr 
m 

+  2  Re{x  lT  7  X  *Nmq} 
m  q*n  q 

+  l  l  XX  *NPmNmq  ] 

p^m  q#m  P  q 

+  ^  ^  [Re{b  }  Re{G(m,n)} 
m  n>m  .  mn 

-  Im{b  }  Im{G(m,n)}  ] 


mn 


where 


G(m,n)  =  l  X  Npm  £  X  *Nq  n 

p  p  q  q 


The  elements  of  the  FIM  are 

(FIM)rt,ik  =  J  I  (g12  '  gis2/g) 

- 1. 1 { l  W^iX"”'2 


B+  °  m 

+2  l  ( (ScosWd  +  Re{N*  })  Re{NmmNmq } 

q*n  mq  mq 

-(-Ssinwd  +  Im{N*  })  Wn^V™1}) 
mq  mq 

+  2  T  l  (CScoswd  +  Re(N*  })  Re{NpmNmq} 
P*»  q>p  Pq  Pq 

-(-Ssinud  +  Im{N*  })  Im{NPmNmq}) 

pq  pq 

+  l  j NPtn | 2  (Scosw  d  +  Re{N*  })] 

PM  pra  pm 

+  2  y  T  [Re{b  }  <  Re{G(m,n)}> 

u  u _  mn 

m  n>m 

-  Im{b  }  <  Im{G(tn,n)}  >]} 
mn 


(29) 


(30) 

(31) 


(32) 
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where 

<Re{G(m,n)}>  =  j  V  (Re{NpiVq}  (S  cosuxi  +  Re{N*  }) 
p  q  pq  pq 

-Im{NpmNnq}  (-S  slnaid  +  Im{N*  }))  (33) 

pq  pq 

and 

<  Im{G(m,n)}>  =  £  J  (Re{NPmNnq}  ( -Ssincod  +  Im{N*  }) 

p  q  pq  pq 

+  Im{NpmNDq}(S  costod  +  Re{N*  })) 

pq  pq 


Use  of  these  elements  in  the  FIM  is  restricted  for  inversion  to  the 
CRMB  to  M-l  independent  delays.  Further  examination  of  (32)  for  diffuse 
noise  is  given  in  Appendix  C. 
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We  now  investigate  for  the  M-l  d^  changes  in  these  earlier  results 
caused  by  consideration  of  noise  which  is  spatially  correlated. 


V.  Maximum  Likelihood  Estimation 

of  the  M-l  Delays  d.-d- 
1  1 


We  again  maximize  A  by  maximizing 


A’  =  -  l  £n  g  +  l  XTN  1V*VTN~1X*/g 
B+  Bi- 


Writing 


T  -1 
X  N 


and  the  m,n —  element 


(J  X  Npl,  J  X  Np2,  . . .,  J  X  Npm) 
'•  P  P  P 

th 


(V*VT)  =  v  =  e  ^dm 
m,n  mn 


(34) 


(35) 


gives 

XTN~1V*VTN-1X*/g  =  -  y  l  v  (£x  Npm  yx  *Nqn) 
g/4-mnLp 

m  n  p  q 

=  ^  y  y  v  (x  r  +  y  x  Npm)  (x  *Nnn  +  y  x*  Nqn) 

g  '•  L  mn  m  h  P  n 

m  n  p#m  r  qy=n 

=  -  l  l  v  (XX  +  X  N™1  y  X  *Nqn 

g  L  mn  m  n  m  4  q 

m  n  qfn 

+  X  *  Nnn  J  X  Npm 
n  p^m  P 

+  l  l  X  X  *  NPmNqtl).  (36) 

p^m  q^n  P  q 

In  this  form  it  may  be  seen  that  (34)  differs  from  the  spatially  uncorrelated 

noise  case  only  in  the  -J  £n  g  term  and  the  terms  in  parentheses  in  (36) 

Bi- 

other  than  X  X  *  N^N1111.  If  p  =  0,  £n  g  is  not  a  function  of  the  delays 
m  n 

and  all  NPq,  p  /  q,  are  zero.  Then  as  the  literature  cited  shows  [3,4], 
maximization  of  (6)  reduces  to  either  a  beamformer  (choosing  M-l  d^)  or  a 
system  of  M(M-l)/2  correlators  (choosing  d^-d^). 


Further  manipulation  of  Eq .  (36)  when  noise  is  diffuse  is  given  in 
App.  A  for  a  special  "worst  case"  when  all  correlations  are  real  and 
equal . 
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Now  note  that 

XTN"1AN“1X*  =  y  J  a  (i)  (X  X  *NmrVln 
'•  L  mn  m  n 

m  n 


+  l  j  X  X  *  NpmNqn)  (42) 

p*n  U  P  q 

Ignoring  the  first  summation  in  (40)  (from  the  in  g  term  of  A)  and  setting 

(42)  equal  to  zero  for  i  =  2,3,...,M  constitutes  M-l  nonlinear  equations 

in  the  M-l  unknowns  d„,  d d  (d,  =  0). 

2.  3  ml 

Equations  (42)  may  be  made  real  by  observing  that  every  (m,n)  term  has 
its  conjugate.  Thus 

XTN"1AN“1X*  =  l  a  (i)  (]x  | 2 (N™") 2  +  2  Re{X  NmmY  X  *Nmq) 
u  mm  m  m  L,  q 

m  qfm  n 

+  y  l  X  X  *  NPmNmq) 
p^m  q^m  P  q 

+  2^  ]  (Re{a  (i) }Re{G (m,n) } 
u  -  mn 

m  n>m 

-Im{a  (i) }lm{G(m,n) })  (43) 

mn 

where 

G(m,n)  =  l  X  Npm  l  X  *Nnq.  (44) 

p  p  q  q 

Because  the  a  (i)  are  functions  of  g.  and  g,  and  g.  and  g  are  functions  of 
ran  l  l 

all  delay  differences  d  -d  ,  the  solution  for  d.  cannot  be  found  in  terms 

P  q  i  1w/d  _d  x 

of  X.  and  X,  alone  nor  even  as  a  linear  combination  of  the  X  X  *  eJ  v  p  q; 
l  1  P  q 

correlators. 

VI.  The  Cramer-Rao  Matrix  Bound  for  the  M-l  Delays  d^-d^. 

It  is  well  known  that  ML  estimators  approach  the  Cramer-Rao  bound 
(CRMB).  The  variance  bounds  for  the  delay  estimates  d^  are  the  diagonal 
elements  in 


CRMB  =  (FIM)_1  =  (-<  grad  (grad  A')T>)-1, 


(45) 
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wherein  FIM  is  the  Fisher  Information  Matrix,  grad  A'  is  a  row  vector  whose 

nr^  element  is  the  derivative  of  A'  with  respect  to  the  m^  delay  d  ,  , 

m+1 

A'  is  the  expression  in  (16),  and  <•>  denotes  expectation.  The  outer  gradient 

9  3  \ 

operator  creates  a  matrix  whose  elements  are  -  (-^~)  .  The  inner  partial 

da,  da . 
k  i 

has  already  been  given  by  (37)  and  (40).  Continuing  we  find  with 

k 

that 

_  _JL  (M_)  =  _  y  1  {_  [_!fi  _  gllk-  ] 

9dk  H  b+  «  l9dk  8  1 

T  -1  32(V*VT)  fk  3 (V*VT  ) 

A  N  1  3d,  3d.  "  g  3d. 

k  l  i 

_  I  !fi  v*VT  -  i  8i  9.CV;,<.YT). 

g  3dk  g  3dk 


+  ~ '  8i8kv*VT]N  1X*} 
8 


(46) 


If  k  /  i,  then 


3gi 
3k 


gfk  =  -g-p1  =  2u/(Re{Nik)  cos  U)(d^-dk)  +  Im{N11C}  sin  cotd^-d^)  (47a) 


,iki 


and 


f32(V*VT)  v 

^9d,3d.  ' 

k  x  m,n 


0,  (m,n)  #  (k, i)  or  (i,k) 
w2e^W(dk  di9,  (m,n)  =  (k,i) 
w^e  ^W^dk  di\  (m,n)  =  (i,k) 


(47b) 


These  give 


_J_  (Ml )  =  y  —  fg  -  g  g  /g] 
9dk  9di  B+  8  §ik  8i8k  S 

1  „T.  -1, 


-T  i  XlN  UN  X* 

u  rr 


B+ 


8 


(48) 


where  u  have  the  following  values 
mn 

m  £  i,k;  n  £  l,k 

.  ",gik  2gi8k  jw(d  -d  ) 
umn  ~^2  >  e  m  n 


(49a) 
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n,n)  =  (k, 1)  or  (l,k) 

(l2  _  !ik  +  ffA  +  .  h  .mw 

kt  g  g2  g  g 

u,,  =  u.  .* 
ik  ki 

=  k;  n  £  l,k  or  n  =  k;  m  ^  i,k 

,  Blk  2gi8k  8i  ,  ,  Ju(d  -d  ) 

—  +  —  -J-1'X  k  " 

u  ,  =  u,  * 
mk  km 

=  1;  n  t  1,  k  or  n  -  1;  m  ^  i,k 

r8ik  ,  2gi8k  gk  .  N  ju)(d .  -d  ) 

u.  =  ( -  +  - rr-  -  JU3)  eJ  l  n' 

ln  g  g2  g 

u  .  =  u .  * 
mi  lm 


~gik  2gigk 

u  =  (-i*  +  ) 

mm  g  g2 


Now  the  (FIM)  may  be  written  (  i  7*  k) 


(FIM)ik  l,  g  [gik  "  8i8k/g^ 


--<  l  [In  (|X  |2(Nmm)2 
g  4  nm  m1 

+2  Re{X  l  X  *Nmq} 
m  q£m  q 

+y  l  X  X  *  NPmNmq) 

p?hn  qjhn  P  q 

+2  J  y  (Re{u  }  Re{G(m,n)} 

u  “  mn 

m  n>m 

-Im{u  }lm{G(m,n) }) ]> 
mn 

where  G(m,n)  =  \  X  NPm  \  X  *N°q  as  in  (44). 

p  p  q  q 


(49b) 


(49c) 


(49d) 


(49e) 


Writing  all  XpX^*  as  in  C29  )  gives 


_  -ju)(d  -d  )  x  N  ,  p  +  q 

<x  x  *>  =  {Se  p  q  pq 

p  q  S  +  Nx,  p  =  q 

<Re{G(m,n)}>  -  l  l  (Re(NPmNnq }  (S  cosw(d  -d^)  +  Re{/q} 

P  9 

-Im{NpmNnq}  (-S  sinu)(d  -d  )  +  Im{N*  })) 

p  q  pq 

<Im{G(m,n)}>  J,  (Re{NPmXn  1  }(-S  sinui(d  -d  )  +  Im{N*  )) 

p  q  p  q  pq 

+  Im{NPVq}(S  cosu)(dp-dq)  +  Re{N*q})) 


l  l  NPmNmti  <X  X  *> 

<-•  n  n 


p^m  qjtra 


=  2  y  \  [Re{NPmN  q}(S  cosu)(d  -d  )  +  Re(N  }) 
p^m  q>p  ,  jf  m  P  q 

-Im{Npr1I'jraq}  (-S  sinii>(dp-d^)  +  In{ff  ^}) 


+  l  ( 1  NPm|  2  (S  +  Nx) 

p^ra 


(FIM)ik=  Li  (8ik  "  gi8k/8) 

-U  a  Voi<s«1)(»"”): 


B+  m 


+  2  y  (Re{N  N  ^}(S  cosa)(d  -d  )  +  Re{N  } 

m  n  mn 


-lm{NmmNmq}  (-S  simo(d  -d  )  +  Im{N*  })) 

m  q  mq 

+  2  y  £  (Re{NpmNm^}  (S  cosu)(d  -d  )  +  Re(N*  )) 
p*nq>P>*n  P  Pq 

-Im{NPmNmq)  (-S  sina)(d  -d  )  +  Im{N*  })) 

m  q  mq 

+  l  |  NPm  |  2  (s  +  N  )] 

1 

+  2  7  y  [Re{u  }  <  Re{G(m,n)}> 

L  t  mn 

m  n>m 

-Im{u  }  <  Im{C(m,n)}  >]} 


For  the  diagonals  of  the  FIM,  let 


k  =  i ,  then 


3g .  - 

=  g..  =  -2u)  7  (Re{N  P}cosoj(d.-d  ) 

3d,  11  h.  l  p 

k  ,  .  pfi 

k=i  r 

-Im{Nlp}  sinco(d.-d  )) 
i  P 


2  T 

9  (V*V  )  2 

- — - =  -to  , 


ejto(d1-d.)  \ 

eja)(d2"di)  -0- 


>(drdl>  e^W  _  eJU)(drdM) 


Jco(dM-di) 


These  give 


~~~~2  =  I  “  {[8ii  ~  8i2/g^  "  XV2WN  2X*} 

9d^  B+  8  1 

where  w  have  the  following  values, 
mn 

m^i,  n^i,  m^n 

,  .  .  jw(d  -d  )  2,  2.  jto(d  -d  ) 

w  =(-g.</g)  e  m  n  +  2(g  /g  )  eJ  m  n 
mn  ii  i 

m=i,n?tiorn  =  i,m^i 


(-w2  -  gii/g  +  2  giZ/g2  -  2(gi/g)ju>)  ejU)(di  dn) 


w  =  w ,  7 
mn  im 


=  -  gii/8  +  2  8i2/g2 


Using  the  above  results  gives 


1 

g 
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l  {  I  w  [(S+N UN™)2 
B+  m  mm  1 

+  2Nmra  £  ((S  coSu)(d  -d  )  +  Re{ N*  })Re{Nmq} 

5  m  q  mq 

qfm 

-(-6  sinoj(d  -d  )  +  Im  {N  })  Im{Nmq}) 
m  q  mq 

+2  l  l  (S  cosw(d  -d  )  +  Re{N*  !)  Re{Np,nNraq} 

p£m  q  >  p,  ?*m  P  q  PQ 

-(-S  siaui(d  -d  )  +  Im{N*q»  Im{NpmNmq}) 

+  I  I  NPm  |  (  S  +  Jh  )  ] 

P*n  1 

+  2  T  y  [Re{w  }  <  Re{G(m,n)j  > 
m  n>m 

-Im{w  }  <  Im  {G(m,n)}  >]} 
mn 

To  compare  with  previous  results  observe  in  (55)  and  (60)  that  if  noise. 

is  spatially  uncorrelated,  =  0,  and  only  =  =  w2  e'^^i  dk^  and 

w.  =  w*.  =  -cu2  e-jw(^i  dn)  are  non-zero.  Further,  in  (52)  and  (53)  p  =  m 

mm 

and  q  *=  n  are  the  only  non-zero  terms.  Utilizing  the  above, 


(FIM)  =  -2  1  ~~  (cosw^-d^)  Ni:LNkk  S  costu^-d^) 


i i  kk 

+  sinuKd^-d^)  N  N  S  sinio(di-d^) ) 

2  .... 

V  u)  n  kk„ 

=-2  L  —  N  N  S, 

B+  s 


where  g  =  -r  +  l  N11, 


and  similarly 


v  V  00  Mii„nn  „ 

(FIM)  .  .  =  21  >  —  N  N  Sl 

n  B+  njHg 


It  is  readily  seen  that  this  FIM  is  identical  to  Eq .  7  (the  same  as  Eq .  12 
in  [3 J ) . 

Unfortunately  the  FIM  defined  by  (55)  and  (60)  has  elements  which  are 
in  general  functions  of  the  delays  themselves,  making  analysis  difficult. 
However,  in  the  next  section  we  will  assume  a  signal  source  at  infinity, 
allowing  some  simplification. 
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VII.  Evaluation  of  the  CRMB 


It  is  unreasonable  to  evaluate  and  invert  the  FIM  in  sections  IV  or 
VI  in  general  because  it  is  a  function  of  all  d^.  However,  if  wavefront 
curvature  is  ignored,  each  delay  may  be  written  d^  =  iA  where  A  is  the 
delay  between  adjacent  sensors.  We  may  also  let  A  vary  between  zero  and 
u>A  =  it  for  a  single  frequency.  Then  d^  -  d^  =  (p-q)A  for  example.  This 
is  the  beam  former  case. 

Because  of  the  generality  of  the  formulas  we  may  also  vary  the  elements 
of  N,  using  the  symmetric  matrix  (as  in  [11]) 


v’ 

Such  a  correlation  is  appropriate  for  turbulent 
boundary  layer  noises  and  its  magnitude  with  respect  to  the  unity  diagonal 
accounts  for  isotropic  noise.  In  the  following  simulations  we  choose  jp^|= 
0,  0.2,  0.4  and  having  values  0  through  tt/2. 

Figures  1-24  show  the  CRMB  (1,1)  element,  center  element,  or  last 
element  as  a  function  of  the  various  parameters.  Table  I  is  presented  as 
a  guide  to  comparisons. 

The  formulas  for  the  FIM  may  be  applied  to  arrays  with  clustered 
elements  as  well,  if  the  spacing  between  clusters  is  considered.  We  have 
done  this  in  producing  the  data  in  Figures  25  througli  30.  Zero  correlation 
between  clusters  is  assumed. 

The  clustered  (or  grouped)  arrays  studied  are  as  shown  here. 


\ 

,  .  -ra  iwd 

wherein  p  =  p  e  e  . 
r  o 


*■  3  sensors 
•*-  9  sensors 
*■  15  sensors 


The  spacing  between  array  ends  and  ends-to-center  remains  fixed.  The 
effect  of  adding  sensors  to  the  cluster  when  spatially  correlated  noise 
is  present  can  then  be  observed. 

Comments  derived  from  the  Figures  are  as  follows 


Table  I.  Guide  to  Figure  Variables 
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1.  Figures  1  through  9  show  that  variance  decreases  monotonically 
with  SNR  and  that  variations  in  p  from  0  through  0.4  /45°  have 
unpredictable,  but  not  large  effects. 

2.  Figures  1  and  7  for  example  show  that  more  sensors  (from  3  to 
15)  will  reduce  the  variance  of  a  delay. 

3.  Figures  1,2  or  3,4  or  5,6  or  7,8,9  show  that  variance  bounds  for 
delays  end-to-center  will  vary  with  p  differently  than  those  for 
end-to-end,  but  not  a  lot.  Also  the  end-to-end  delays  vary 

least.  '  • 

4.  Comparing  Figs.  1  and  3  for  example  shows  that  the  effect  of  p 

on  a  delay  estimator  will  vary  with  ojA  (look  angle.)  This  variance 
is  easier  to  see  in  Figures  10-24. 

5.  Figures  10-24  demonstrate  that  the  bounds  are  effected  by  look 
angle  to  a  much  larger  extent  when  p  is  increased  to  0.4.  As  much 

as  5dB  (Figs.  11,17)  is  observed  at  SNR  =  0.1.  1  ’ 

6.  Comparing  Figures  in  10-24  with  like  SNR  and  M  shows  that  different 
delays  are  effected  quite  differently  as  coA  varies;  i.e.  CRMB(1,1), 

(2,2),  (7,7)  or  (14,14)  all  vary  differently  with  P  and  ioA. 

7.  Grouping  sensors  when  spatial  noise  correlation  is  present  has 
a  detrimental  effect  at  low  SNR.  This  may  be  seen  in  Figures 

25,  26,  which  also  show  that  the  midpoint  and  end  delay  variances 

are  equal  at  wA  =  0.  (They  are  not  equal  at  other  ojA  per  comment  j 

4  above).  The  difference  between  curves  A  and  B  is  that  the  9x9 

noise  covariance  matrix  for  curve  B  has  3x3  blocks  on  the  j 

t  i 

diagonal  while  curve  A's  noise  matrix  is  full.  Thus  curve  A 
represents  a  cluster  of  nine  sensors  while  curve  B  assumes  each 
cluster  of  3  has  noise  independent  from  the  other  clusters.  For 
p  =  0.2  and  wA  =  0  the  effect  is  0.3  dB  at  SNR  =  0.1. 

8.  Pursuing  the  question  of  how  much  clustering  is  effective  when 

i 

spatial  noise  is  present.  Figures  27  through  30  plot  the  variance  < 

bounds  vs  sensor  number  M  while  holding  array  length  constant. 

We  conclude  that  delay  variances  are  reduced  much  less  for  M 

changing  from  9  to  15  than  for  M  changing  from  3  to  9.  •! 
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The  last  comment  is  meant  to  be  one  of  the  basic  conclusions  of  this 
study:  that  for  significant  spatially  correlated  noise,  there  is  a  point 
beyond  which  it  does  not  pay  to  increase  sensor  number  in  a  cluster  when 
the  purpose  is  to  reduce  delay  variance  between  clusters. 
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Figure  5. 


CRMB(1,1)  vs  SNR.M-3 .  A — p=0,  B — p=0. 2 ,  C~P=j0.2; 
D — p=0.4 ,  E — p=j0.4,  F — p=0.4(l+j)  .tuA- ti/2 
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Figure  11.  CRMB(2,2)  vs  wA.  M=3.  A — p=0.0,  B — p=0.2; 

C— p=0.A.SNR=0.1 
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Figure  17.  CRMB(7,7)  vs  wA. 

C — p=0.4.SNR=0.1 


M=15 .  A — p=0.0,  B — p=0. 2 ; 
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Figure  18.  CRMB(14,14)  vs  wA. 

C — p=0. 4. SNR=0. 1 


M=15.  A — p=0.0,  B — p=0. 2 ; 
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Figure  23.  CRMB(7,7)  vs  wA.  M=15.  A — p=0.0,  B--p=0.2; 
C— P=0.4.SNR=10.0 
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CRMB(8,8)  vs  SNR.  M=9,  0=0.2,  wA=0.  A  —  equally 
spaced  sensors  with  full  9x9  N-matrix,  B — equally 
spaced  sensors  with  3x3  block-diagonal  N  matrix 
(cluster-independent  noise) . 
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VIII.  Conclusions 

Although  a  closed-form  solution  for  the  ML  estimate  of  the  d.,  has  not 

lk 

been  obtained,  nonlinear  equations  which  theoretically  may  be  solved  are 
derived.  These  show  considerable  complexity  which  might  be  somewhat 
reduced  under  rather  confining  conditions.  No  simple  hardware  analogy  is 
apparent. 

The  fact  that  the  ML  estimators  of  the  d.,  are  functions  of  all  the 

lk 

other  delays  may  be  a  positive  observation,  that  is,  no  one  delay  is  estimated 
without  consideration  of  the  others.  However,  it  has  been  shown  (at  least 
for  uncorrelated  noises)  by  Schultheiss  [5]  that  M-l  delays  are  sufficient 
in  practicality  except  when  all  sensors  have  small  SNR.  In  fact  the  CRMB 
may  not  be  found  from  (FIM)  ^  using  the  formulas  given  herein  unless  an 
independent  set  of  d  ^  is  used. 

The  variances  computed  for  the  delays  d^  show  considerable  -  several 
dB  -  deviation  as  p  varies  and  as  M  varies.  The  effect  is  greater  at  some 
look  angles  than  others,  and  also  depends  on  which  delay  is  considered. 

For  sufficient  spatially  correlated  noise,  clustering  sensors  is  not 
efficient  beyond  a  certain  number.  Here  we  show  6  to  9  sensors  is  a 
reasonable  number. 


Appendix  A.  Evaluation  of  the  M(M-l)/2 
Delay  Equations  for  Dispersive  Noise 


A1 


Cron  and  Sherman  [7]  have  found  spatial  correlation  factors  as  a 
function  of  sensor  separation  distance  and  wavelength  for  diffuse  surface 
noise  and  for  diffuse  volume  noise.  If  distances  between  all  sensors 
considered  are  small  with  respect  to  half-wavelength,  the  correlations  are 
all  essentially  a  constant.  Although  long  arrays  span  much  more  than  half 
a  wavelength,  a  constant  correlation  is  useful  when  some  of  the  sensors  are 
clustered.  At  half  wavelength  the  correlation  is  zero  for  volume  noise, 
but  the  zero  location  varies  with  other  geometrical  parameters  for  surface 
noise.  Both  Cron  and  Sherman  [7]  and  Piersol  [8]  have  suggested  exploiting 
the  correlation  zero  distances  to  improve  delay  estimation;  the  implication 
being  that  the  less  correlation  the  better.  Thus  it  is  reasonable  to  assume 
a  worst  case  in  which  noise  at  any  two  sensors  has  a  maximum  correlation 
p  =  p(k).  Due  to  the  symmetry  of  the  diffuse  noise  source,  there  is  no 
time  delay  associated  with  the  correlation;  i.e.,  all  noise  cross  spectra 
are  real.  Thus  let  the  cross  spectral  matrix  for  diffuse  noise  be 


For  this  N,  use  of  the  theorem 
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Eq.  (19)  may  be  written 

l  {  -  g,/g  +  XTn'1UN_1X*}  =  0.  (A3) 

B+ 

where  the  elements  u  are  given  in  Eq.  (21),  and  g  is  in  (20c). 
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A  simplification  may  be  obtained  by  observing  the  relative  magnitude  of 

SVTN_1V*  =  S l  l  Npq  ejwdpq 
p  q 

=  S(MN1:L  +  2  l  l  NPqcoswd  ). 
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Substituting  (A2)  into  (A4j  gives 
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Since  there  are  M(M-l)/2  terms  in  the  double  sum  and  ] cos0 |  <  1, 
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Using  (A7)  in  (21)  gives 

-  2pslnarfik),  -(i.k) 

m(l-p) 

2psinu)d , 


we 


u  -  —  J  We  ^wdik(-j  - 

mn  «  1  Ml 


ik  ),  (m,n)  =  (k,i) 


-2pwe^a)dmn  sinwd^ 


(A6) 


(A7) 


(A8) 


M(l-p) 


(m.n)  +  (i.k),  (k,i) 
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The  following  steps  will  lead  to  an  equation,  nonlinear,  for 

in  terms  of  the  other  delays  and  having  only  real  quantities.  Thus  the  d^ 

terms  are  separated  from  others  in  the  summations.  The  set  of  M(M-l)/2 
equations  could  theoretically  be  solved  for  any  M-l  independent  unknowns 
d^.  Further,  assumptions  about  large  M,  small  p,  or  small  d^  lead  to 
simplifications  and  linearizations,  but  these  are  not  pursued  here. 
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Grouping  index  pairs  (p,q)  according  to  matches  with  either  m  or  n  or 

both  in  e±Jwdmn  and  using  a  and  8  for  the  N_1  elements  gives  (see  Appendix  B) 
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where  p'  and  q'  indicate  omission  in  their  sequences  of  r  and  t  for  the 


JcJd 


jwd-, 


eJ  rt  terms  or  i  and  k  for  the  e  ik  terms. 

Noting  that  the  coefficients  of  e'^^inn  are  complex  conjugates,  we  may 
write,  using 
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where  p=lifr=t,p=2  otherwise. 

Note  that  all  elements  in  Eq.  (All)  are  real  because  for  example 
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First  simplifications  of  (All)  may  be  obtained  by  observing  3»|a|  when 

1  +  (M— 2) p>>  j  P } ,  which  is  often  true.  The  2wasinod.,  term  is  negligible 

2 

with  respect  to  any  of  the  8  or  0a  terms,  particularly  at  large  SNR.  Also 


at  large  SNR,  terms  such  as  Re(X  X  *}  are  approximately  equal  to  S  cosod  , 
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and  terms  such  as  I  (X  X  *}  are  approximately  Ssinod  .  If  2p/ (M(1-P))<<1, 
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many  terms  drop  out. 

If  the  double  sum  over  r,t  could  be  omitted,  and  if  odd. ,«1,  the 
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equation  could  be  linearized,  but  this  is  not  generally  feasible.  There 

are  M(M-l)/2  terms  in  the  double  sum,  each  of  comparable  magnitude  to  the 

d^k  terms,  and  the  double  sum  is  multiplied  by  2po  sincod^^/dKl-p)) .  So 
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or  (M-l)p/ (l-p)<<l.  This  is  not  likely. 
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Appendix  B.  Separation  of  Terms,  Diffuse  Noise 

In  Eq.  (A9) the  double  sum  over  r,t  is  broken  into  parts  for  (r,t)  # 
(i,k),  (k,i)  and  (r,t)  =  (i,k),  (k,i).  Each  part  then  has  terms  such  as 

ejwdik  IJXX  *NPiNkq  +  e'^ik  H  X  X  Wq 

pq  pq 

pq  pq 

wherein  r  and  t  replace  i  and  k  for  the  other  part  of  (A9).  The  double  sum 
over  p,  q  may  further  be  broken  down  into  parts  for  which  p  or  q  or  both 
are  equal  to  i  or  k  or  both,  each  case  giving  different  values  for  or 

kq  *4“ 

N  .  These  give  the  following  results,  using  3  and  a  from  (A2)  and  e  and 
e“  for  the  exponentials.  (Similar  results  are  obtained  for  the  difference 
of  the  conjugate  exponentials,  yielding  sinukL^  terms). 
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Appendix  C.  Evaluation  of  FIM  for  Diffuse  Noise, 

An  Independent  Subset  of  M(M-l)/2  Delays 

The  following  applies  to  any  subset  of  M-l  independent  delays  d^k> 


To  determine  the  FIM,  we  must  calculate  the  expected  values  of  X^X^* 
using  the  noise  matrix  in  (Al) .  This  gives 

<X  X  *>  =  {  .  ,  S  +  N1  ’  r  =  1 

T  Se  ^  rt  +  pN^,  r  ^  t 


(Cl) 


We  also  note  that  (23)  becomes  for  real  N 
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The  elements  of  A(m,n)  =  (a  )  are  (using  ( 24 ) — ( 28 )  and  real  N) 
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Now  from  (C2)  we  may  expand 
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Applying  (Cl),  (C3)  and  (C4)  to  (c2)  and  using  the  separation-of- 
terms  process  in  Appendix  B  gives  for  the  diagonal  elements  of  the  FIM, 
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Some  reduction  in  the  number  of  terms  may  be  obtained  by  gathering 

coefficients  of  sines  and  cosines,  but  this  will  not  be  done  here.  Rather 

the  various  terms  are  left  for  better  inspection  and  identification  with 

their  sources.  However,  let  it  be  observed  that  the  diagonal  elements 

(FIM)  may  be  written 
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where  A^,  A and  A^  are  as  indicated  in  (C5).  These  will  be  used  again  in 
the  off-diagonal  elements'  expression. 

The  off-diagonals  are  found  similarly. 


Utilizing  functions  A A 2,  and  A3  as  in  (C5)  and  ( C4)  the 
off-diagonals  are 
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A  few  remarks  are  in  order  at  this  point.  The  obvious  feature  is  that 

expressions  (C6)  and  (C7 )  for  the  FIM  elements  are  very  complex;  they  are 

functions  not  only  of  the  delays  whose  covariance  is  sought  but  also  of 

2 

all  other  delays.  One  simplification  is  to  discard  a  and/or  a-  factor  terms 
2 

with  respect  to  0  terms.  Another  is  to  consider  the  case  where  all  delays 
are  equal  to  zero.  For  a  zero  delay  vector,  the  covariances  in  (C7)  are 
also  zero,  the  inversion  of  the  FIM  is  considerably  simplified,  and  the 
diagonal  elements  of  FIM  and  their  inverses  are  functions  of  p,M,S  and  only. 


It  is  interesting  that  in  this  zero-delay  situation  the  covariance 
of  two  delays  is  zero.  This  differs  from  the  ML  estimation  of  the  M-l 
delays  referred  to  a  single  sensor  (see  Eq.  7).  Those  delays  have  a  non¬ 
zero  covariance  with  or  without  correlated  noise.  Mathematically  the 
difference  is  between  3  3V  .  and  3  .  3V  . 


3  3V*VT  and  3  .  3V*VT 

3drt  <~33IT  ’  3d2  Sdl 


The  second-order  partial  with  double  subscripted  variables  is  zero,  while 

*  X 

that  with  single  subscripts  is  not.  This  is  because  the  elements  of  V  V 
are  of  the  form  exp(joj(d^-d^))  =  exp(ju)d^).  For  example  if  =  d.  and 


d2  =  dk,  then 


*  T 
3V  V 


)  yields  an  element  W  exp( juKd^-d,,) )  /  0,  but 


(V  V  )  =0.  Further,  if  p  =  0,  then  the  off-diagonal  elements  of 


the  FIM  of  the  d^k  are  always  zero.  Evidently  with  spatially  uncorrelated 
noise,  ML  estimates  of  the  d^k  are  uncorrelated,  although  either  the 
generalized  cross-correlator  measurements  of  d^k  which  yield  ML  estimates 
of  the  dj  [3,4]  or  the  ML  estimates  of  the  M-l  delays  d^  are  correlated, 
as  shown  in  Eqs.  (13)  and  (7). 
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